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(54) Abstract Title , , 

Imaging device for selecting most in focus image from plural stored images. 

(57) A digital Image recording device 105 with a fixed lens system 110 for easily and automatically recording 
a focused image 155 of an object 140. Successive Images 155 of the object are recorded at various 
obiect-to-lens distances 160, and a program 430 is used to select the image 155 stored in memory 420 which is 
closest to be in focus. The program 430 could be stored either In static or dynamic memory. In a representative 
embodiment, this image 155 Is selected by computing image contrast values (610, figure 6) obtained using a 
focus function (630. figure 6). The image 155 corresponding to the largest focus function value (630) is selected 
as the one closest to being in focus. 
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METHOD AND APPARATUS FOR 
AUTOMATIC PAGE CAPTURE BY DIGITAL CAMERA 

FIELD OF THE INVENTION 

The present invention relates generally to digital image recording devices, more 
particularly to digital cameras and digital video cameras, and even more particularly to 
the focus of such devices. 

BACKGROUND OF THE INVENTION 

In order to record clear images of objects at varying distances from a digital 
image recording device such as a digital camera or digital video camera, the image 
projected onto the film or image sensor used for image capture must be in focus. A 
typical method to obtain such focus is to vary the distance between the lens ind the plane 
of the film or image sensor either manually or automatically in relation to the distance 
from the object to the lens. 

However, less expensive cameras can be produced using a fixed lens system. In 
such cameras, the distance from the lens to the plane of exposure is fixed. Now, 
however, obtaining a clear image becomes more difficult, as the camera must be moved 
to a fixed distance from the object at which the object is in focus. The focus object-to- 
lens distance is defined by the focal length of the lens system and the lens-to-plane-of- 
exposure distance, wherein the lens-to-plane-of-exposure distance is the distance between 
the lens of the digital image recording device and the plane of the film or image sensor 
used to record the image of the object. Among other means, the focus object-to-lens 
distance can be obtained and subsequently adjusted by either (1) guessing the distance, 
(2) using an optical range-finder, (3) forming two images on an image sensor from two 
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lenses located a short distance apart, using a mirror to move one of the images until the 
two sets of signals produced by the two images on the sensor have maximum correlation, 
and then correlating the object-to-lens distance with the position of the mirror, (4) 
measuring the time taken for an ultrasonic wave pulse to reach the object and be reflected 
5 back to a detector on the camera, (5) measuring the amount of light or infira-red radiation 
reflected back from a scene from an emitted flash and correlating that measurement to 
the object-to-lens distance based on the average reflectance observed with scenes of 
average reflectance, and (6) viewing the image prior to exposure as in a single-lens reflex 
camera. All these methods are useful, but all have their disadvantages. Guessing is at 

10 best error prone, wMe the other techniques are expensive and time consuming as they 
may require additional equipment and several iterations of measurements with 
subsequent adjustment of the object-to-lens distance before making an exposure. In 
addition, false readings may occur in some situations depending upon the technique used. 
As an example, a heavily illuminated scene could indicate a false object-to-lens distance 

IS if that distance is set using the measurement of object reflected light from an emitted 
flash. Lens systems having a large range of object-to-lens distances in which the image 
of the object is in focus have also been used but are useful only when object-to-l^is 
distances are large. 

Thus, there is a need for an image exposure system that can easily, accurately, 
20 inexpensively, and automatically capture focused images using flxed lens systems. 
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SUMMARY OF THE INVENTION 

In preferred embodiments, the present patent document describes method and 
apparatus for obtaining a focused image using a digital image recording device having 
5 a fixed lens-to-piane-of-exposure distance, wherein the lens-to-plane-of-exposure 
distance is the distance between the lens of the digital image recording device and the 
plane of the film or image sensor used to record the image. In a preferred embodiment, 
a digital image recording device, which could be a digital camera or a digital video 
camera, automatically records a set of successively detected images of an object at 
10 varying object-to-lens distances and identifies the image most in focus of the set of 
images recorded. 

To obtain the set of images, either the camera or the object whose image is to be 
recorded is moved relative to the other. A preferred embodiment computes a contrast 
value for each stored image and chooses the image with the greatest contrast value to be 
IS the image most in focus. The other images are more blurred, thus having a smaller 
computed contrast value. 

In an alternative embodiment, a distance determination device detects the position 
at which the image projected onto the image sensor is in focus and automatically enables 
recording of the image detected at that distance. The distance determination device could 
20 be a distance meter or similar device. 

Other aspects and advantages of the present invention will become apparent from 
the following detailed description, taken in conjunction with the accompanying drawings, 
illustrating by way of example the principles of the invention. 



3 




BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings provide visual representations which will be used 
to more fully describe the invention and can be used by those skilled in the art to better 
5 understand it and its inherent advantages. In these drawings, like reference numerals 
identify corresponding elements and: 

Figure 1 is a drawing of a digital image recording device in accordance with the 
invention. 

Figure 2 is another drawing of the digital image recording device in accordance 
1 0 with the invention. 

Figure 3 is yet another drawing of the digitsil image recording device in 
accordance with the invention. 

Figure 4 is a drawing of a digital image system in accordance with the invention. 

Figure 5 is another drawing of a digital image system in accordance with the 
1 5 invention. 

Figure 6 is a graph of the results of computing a contrast value for successive 
stored images in the memory in accordance with the invention. 

Figure 7 is a drawing of a circuit for selecting the image most in focus in 
accordance with the invention. 
20 Figure 8 is a flow chart of method steps for selecting the image most in focus in 

accordance with the invention. 

Figiu-e 9 is an additional drawing of the digital image recording device in 
accordance with the invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

1. Introduction 

As shown in the drawings for purposes of illustration, the present patent 
5 document describes method and apparatus for obtaining a focused image using a digital 
image recording device having a fixed lens-to-plane-of-exposure distance, wherein the 
lens-to-plane-of-exposure distance is the distance between the lens of the digital image 
recording device and the plane of the film or image sensor used to record the image of 
an object. In a preferred embodiment, a digital image recording device, such as a digital 
10 camera or a digital video camera, having a fixed lens-to-plane-of-exposure distance 
automatically records a set of successively detected images of an object and identifies the 
most focused image of the set of images recorded. In the following detailed description 
and in the several figures of the drawings, like elements are identified with like reference 
numerals. 

15 

2. Discussion 

Figure 1 is a drawing of a digital image recording device 105 in accordance with 
the invention. In a preferred embodiment, the digital image recording device 105 
comprises a lens 110 and an image sensor 130 wherein the lens 110 is placed at a fixed 

20 distance fi-om the image sensor 130. This fixed distance is referred to herein as the lens- 
to-plane-of-exposure distance 120 and also as the lens-to-image-sensor distance 120. The 
digital image recoiding device 105 could be, for example, a digital camera 105 or a 
digital video camera 105. In figure 1, an object 140 is shown at a first, a second, and a 
third positions 151,152,153 relative to the digital image recording device 105. The 

25 object-to-lens distance 160 of the first position 151 is less than the object-to-lens distance 
160 of the second position 152, and the object-to-lens distance 160 of the second position 
152 is less than the object-to-lens distance 160 of the third position 153. These relative 
positions 151,152,153 could be obtained by movement of either the object 140 or the 
digital image recording device 105. Note that in figure 1 an image 155 of the object 140, 

30 which could be for example the image 155 of a sheet of paper 140, is only projected in 
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focus onto the image sensor 130 when it is placed in a fixed focal plane 170 of the lens 
110 which is shown in figure 1 as the second position 152. At other object-to-lens 
distances 160 the image 155 of the object 140 projected onto the image sensor 130 will 
be out of focus. 

5 Figure 2 is another drawing of the digital image recording device 105 in 

accordance with the invention. In figure 2 the object 140 is located at the first position 
151. In this situation the image 155 of the object 140 projected onto the image sensor 
130 is out of focus as the fixed focal plane 170 lies at a greater distance from the lens 110 
than the object 160 does. For purposes of ease and clarity of illustration, the image 

10 sensor 130 and the image 155 are shovwi in figure 1 but not in figure 2. As shown in 
figure 2, an operator moves the digital image recording device 105 away firom the object 
140 parallel to a y-axis 280 in the direction indicated as camera motion 290, thereby 
increasing the object-to-lens distance 160. 

Figure 3 is yet another drawing of the digital image recording device 105 in 

1 5 accordance with the invention. In figure 3 the digital image recordmg device 105 has 
been moved away fix)m the object 140 with respect to its location in figure 2. In fiict, the 
object 140 of figure 3 is now located at the second position 152, and the image 155 of the 
object 140 projected oiito the image sensor 130, is now in focus, as the fixed focal plane 
170 lies at the same distance fix)m the lens 110 as the object 140 does. Again, for 

20 purposes of ease and clarity of illustration, the image sensor 130 and the image 155 are 
shown in figure I but not in figure 3. As indicated in figure 3, the operator continues to 
move the digital image recording device 105 away from the object 140 in a direction 
parallel to the y-axis 280 in the direction indicated as camera motion 290 in both figures 
2 and 3, thereby increasing the object-to-lens distance 160. While, for illustrative 

25 purposes in figures 2 and 3, only two position^ 151,152 have been shown for the object 
140 with respect to the lens 110, in the preferred embodiment the object-to-lens distance 
160 continuously changes from the first position 151, wherein the object-to-lens distance 
160 is less than the distance from the lens 1 10 to the fixed focal plane 170, through the 
second position 152, wherein the image 155 projected onto the image sensor 130 is in 

30 focus, to the third position 153, wherein the object-to-lens distance 160 is greater than the 
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distance from the lens 110 to the fixed focal plane 170. It will be noted that it is 
immaterial \v4iether the digital image recording device 105 or the object 140 is moved. 
It is also immaterial whether the relative motion between the object 140 and the digital 
image recording device 105 is away from or toward each other. It is the relative motion 
5 between the two that is important. 

Figure 4 is a drawing of a digital image system 400 in accordance with the 
invention. Figure 4 shows the object 140 located at the fixed focal plane 170 of the lens 
110. This location in figure 4 is for illustrative purposes only, as in operation the digital 
image recording device 105 is moved relative to the location of the object 140. As the 

10 digital image recording device 105 or equivalently the object 140 is moved, successive 
images 155 are projected onto the image sensor 130. Upon activation, a storage circuit 
410 enables storage of the image data in a memory 420. Though other means are 
possible, the storage circuit 410 could be activated by a timer 405, wherein the timer 405 
is turned on and off by an on/off switch 401. Thus, a series of images 155 at varying 

15 object-to-lens distances 160 are recorded in the memory 420. An image selection 
program 430 executed on a digital signal processor 440 retrieves the images 155 from the 
memory 420 and determines the one image 155 having the best focus. The program 430 
could be stored either in static or dynamic memory within or attached to the digital signal 
processor 440. Static memory could be for example ROM, and dynamic memory could 

20 be for example RAM or flash memory. Following the determination of the image 155 
having best focus, the remaining images 155 may be deleted from the memory 420. 

Figure 5 is another drawing of a digital image system 400 in accordance with the 
invention. In this embodiment, the image selection program 430 is executed on a 
computer 540. In this embodiment, images 155 can be stored in the memory 420 and 

25 transferred at a later lime to the computer 540, wherein the image selection program 430 
detemiines the one image 155 having the best focus. The program 430 could be stored 
either in static or dynamic memory within or attached to the computer 540. Static 
memory could be for example ROM or Compact Disk (CD), and dynamic memory could 
be for example RAM, hard disk, floppy, or flash memory. 

30 Figure 6 is a graph of the results of computing a focus lEunction value 610, which 
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could be for example a contrast function value 610, for successive stored images 155 in 
the memory 420 in accordance with the invention. In various embodiments, the 
successive images 155 are taken as illustrated by figures 1-5. While for illustrative 
purposes, the graph of figure 6 is shown as a continuous curve, it is in fact a graph of a 
5 set of discrete values with one value for each stored image 155, of which each was taken 
at a given object-to-iens distance 160 in accordance with the invention. In representative 
examples, this graph is obtained by computing a focus function value 610 for each image 
155 indicated in figure 6 as successive stored images 620 in the memory 420 of figure 
4, for example, using various algorithms such as sum modulus difference, sum of 

10 difiference squared, sum of difference cubed, sum of difference to the fourth power, sum 
of difference to a power, absolute gradient, thresholded absolute gradient, squared 
gradient, Laplacian, thresholded video-signal content, thresholded video signal pixel 
count, signal power, standard deviation, normalized standard deviation, absolute 
variation, and normalized absolute variation. As a specific example, using the sum 

15 modulus difiference method, the focus function value 610 of figure 5 for each image is 
the sum of the absolute difference in intensity between all adjacent pixels in the image. 
As stated, each e3qx>sure stored is related one-to-one to a s^)ecific object-to-lens distance 
160. It is noted that the maximum in the contrast function value 610 identifies the stored 
image closest to being focused. All other stored images 155,620 wOl be somewiiat more 

20 fuzzy due to their lack of focus and will thus have a lower contrast fiinction value 610. 
The image selection program 430 selects the image 155,620 corresponding to a 
maximtmi contrast value 630, also referred to herein as a largest focus fiinction value 
630, as the exposure in focus. All other images may then be deleted from the memory 
420. 

25 Figure 7 is a drawing of an image selection circuit 700 for selecting the image 155 

most in focus in accordance with the invention. The circuit 700 comprises a first logic 
circuit 710 configured for computation and a second logic circuit 720 configured for 
selection. Image data is inputted from the memory 420 into the first logic circuit 710. 
The first logic circuit 710 computes a focus related parameter, which could be for 

30 example the focus fimction value 610 of ftgiu-e 6, for each image inputted into the first 
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logic circuit 710, and transfers the computed focus related parameters to the second logic 
circuit 720 wherein the image 155 most in focus is selected based upon computed focus 
related parameters and preselected criteria. All other images 155 stored in the memory 
420 may then be deleted or the image 155 most in focus can be transferred to another 
5 memory, printed out, or displayed on a computer screen or other output device. 

Figure 8 is a flow chart of method steps for selecting the image 155 most in focus 
in accordance with the invention. 

In a first representative embodiment, in block 810 images 155 from the memory 
420 are inputted into the program 430, wherein the program 430 is executed on the digital 
1 0 signal processor 440 of Figure 4. Block 810 then transfers control to block 820. 

Block 820 computes a focus related parameter, which could be for example the 
focus function value 610 of figure 6, for each image inputted image 155. Block 820 then 
transfers control to block 830. 

Block 830 selects the image 155 most in focus based upon computed focus related 
1 5 parameters and preselected criteria. Block 830 is the termination block for this process. 

In a second representative embodiment, the processes of blocks 820 and 830 are 
implemented as functions of the program 430 executed on the digital signal processor 
440 and the process of block 830 is implemented in hardware, as for example the second 
logic circuit 720 of figure 7. 
20 In a third representative embodiment, the processes of blocks 810 and 820 are 

implemented in hardware, as for example the first logic circuit 710 of figure 7 and the 
process of block 830 is implemented as fimctions of the program 430 executed on the 
digital signal processor 440. 

In a fourth representative embodiment, the processes of blocks 810 and 820 are 
25 implemented in hardware, as for example the first logic circuit 710 of figure 7, and the 
process of block 830 is also implemented in hardware, as for example the second logic 
circuit 720. 

Figure 9 is an additional drawing of the digital image recording device 105 in 
accordance with the invention. In an alternative embodiment, figure 9 shows the object 
30 140 located at the fixed focal plane 170 of the lens 110. This location in this figure is for 
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illustrative purposes only, as in operation the digital image recording device 105 will be 
moved relative to the location of the object 140. In the embodiment shown in figure 9, 
a distance determination device 930 is activated by the on/off switch 401. As the digital 
image recording device 105 or equivalently the object 140 is moved the distance 
5 determination device 930, which could be for example a distance meter 930 or a or a 
range finder 930, identifies the distance at which the image 155 projected onto the image 
sensor 130 is in focus and automatically activates the storage circuit 410 which enables 
storing data for the image 155 into the memory 420. The distance meter 930 could, for 
example, measure distances using a light signal, an infi:ared signal, or an ultrasound 

1 0 signal. Upon activation the stwage circuit 410 enables recording of the image data into 
the memory 420. Thus, while a series of images at varying object-to-lens distances 160 
are projected onto the image sensor 130 only the one image 155 in focus is recorded in 
the memory 420. Other embodiments are also possible, for example the storage circuit 
410 of figure 9 could be used to open and close either a mechanical or an electronic 

15 shutter, thereby permitting only the focused image on the image sensor 130 to be 
recorded in the memory 420. 

3. Concluding Remarks 

A priihaiy advantage of the embodiment as described in the present patent 
20 document over prior digital image recording devices 105 having fixed lens systems 1 10 
is the ability to record a focused image automatically. The operator does not have to 
precisely locate the object 140 in the fixed focal plane 170. Thus, inexpensive, easy to 
use digital image recording devices 105 can be fabricated using the teachings of the 
present patent document. 
25 While the present invention has been described in detail in relation to preferred 

embodiments thereof, the described embodiments have been presented by way of 
example and not by way of limitation. It will be understood by those skilled in the art 
that various changes may be made in the form and details of the described embodiments 
resulting in equivalent embodiments that remain within the scope of the appended claims. 

30 
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CLAIMS 



What is claimed is: 

1. A method for detecting a set of images [155] of an object [140| and for 
identiiying which image [155] is most in fociis, which comprises the steps 
of: 

in a digital image system [100], projecting the images [155] 
through a lens [110] of a digital image recording device [105] 
onto an image sensor [130], wherein the lens [110] has a fixed 
lens-to-sensor distance [120]; 

changing the object-to-lens distance [160], wherein the object 
[140] passes through the fixed focal plane [170] of the lens [110]; 

activating a storage circuit [410] connected to the image sensor 
[130] and to a memory [420]; 

storing images [155] in the memory [420] when the storage circuit 
[410] is activated; 

retrieving the images [155] from the memory [420]; and 



selecting the image [155] most in focus. 

A digital image system (100] for storing a set of images (155] of an object 
[140] and for selecting the most focused image [155] of the set, 
comprising: 

A digital image recording device [105], comprising: 
an image sensor [130]; 

a lens [110]» wherein the lens [110] is located at a fixed 
distance firom the image sensor [130] and wherein the lens 
[110] projects the images [155] onto the image sensor 
[130]; 

a storage circuit [410] connected to the image sensor 
[130]; and 

a memory [420] connected to the storage circtiit [410], 
wherein activation of the storage circuit [410] enables 
storage of die images [155] in the memoiy [420]; and 

a means for selecting the image [155] most in focus* 

The digital image system [100] as recited in claim 2, wherein the means 
for selecting the image [155] most in focus comprises: 

a digital signal processor [440] capable of receiving images [155] 
fi'om the memory [420]; and 
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a program (430) having functions for identifying the image [155] 
most in focus, wherein the program 1430] is executable on the 
digital signal processor (440). 

The digital image system [lOOJ as recited in claim 2, wherein the means 
for selecting the image (1551 most in focus comprises: 

a first logic circuit [710] configured for computation, wherein the 
first logic circuit [710] computes a focus related parameter for 
each image [1551 inputted into the first logic circuit (710); and 

on a digital signal processor [4401, a program [4301 having 
functions for selecting the image [155] most in focus based upon 
computed focus related parameters and preselected criteria . 

The digital image system [100] as recited in claim 2, wherein the means 
for selecting the image [155] most in focus comprises: 

on a digital signal processor [440], a program [430] having 
functions for inputting at least one stored image [155] and for 
computing a focus related parameter for each image [155] 
inputted into the program [430]; and 

a second logic circuit [720] configvu-ed for selection to select the 
image [155] most in focus based upon computed focus related 
parameters and preselected criteria . 

The digital image systei^. [100] as recited in claim 2, wherein the means 
for selecting the image [155] most in focus comprises: 



13 



on a digital signal processor (4401, a program [4301 having 
functions, 

for inputting at least one stored image [155] and for 
computing a focus related parameter for each image [155] 
inputted into the program |430]; and 

for selecting the image [155] most in focus based upon 
computed focus related parameters and preselected 
cfit^a. 

The. digital image system [100] as recited in claim 2, further comprising: 

a first logic circuit [710] configured for computation, wherein the 
first logic circuit (710J computes a focus related parameter for 
each image (155] inputted into the first logic circuit [710]; and 

a second logic circuit [720] configured for selection to select the 
image [155] most in focus based upon computed focus related 
parameters and preselected criteria . 

The digital image system [100] as recited in claim 2, wherein the means 
for selecting the image [155] most in focus comprises: 

a computer [540]; and 

a program [430] having functions for identifying the image [155] 
most in focus, wherein the program [430] is executable on the 
computer [540]. 
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A method for recording a focused image [155] of an object (140], which 
comprises the steps of: 

in a digital image recording device [105), projecting the im^es 
[155] through a lens [110], wherein the lens [110] has a fixed 
lens-to-sensor distance [120] and a fixed focal plane [170], onto 
an image sensor [130]; 

changing the object-to-iens distance [160], wherein the object 
[140] passes through the fixed focal plane [170] of the lens [110]; 

detecting when the object [140] passes through the fixed focal 
plane [170] using a distance determination device [830]; 

automatically activating a storage circuit [410] connected to the 
image sensor [130] and to a memory [420] when the object [170] 
passes through the fixed focal plane [170]; and 

storing the image [155] in the memory [420] when the storage 
circuit [410] is activated. 

A digital image recording device [105] for recording a focused image 
[155] of an object [140], comprising: 

an image sensor [220]; 

a lens [110], wherein the lens [110] is located at a fixed distance 
from the image sensor [220] and wherein the lens [110] projects 
the images [155] onto the image sensor [220]; 
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10 ^ a storage circuit [410] connected to the image sensor [130]; 

12 a memory [420] connected to the storage circuit [410], wherein 

activation of the storage circuit [410] enables storage of the 
14 images [155] in the memory I420I; and 

16 a distance determination device [830] coimected to the storage 

circuit, wherein at a preselected object-to-lens distance (160] the 

18 distance deterr nation device [830] activates the storage circuit 

[410|. 
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